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® Methods and apparatus for cell analysis. 

@ A method and apparatus are used to measure selected features of parameters of cells by optical 
identification of marked cells. Preferably, an optical enhancement factor, such as a chromogen, is bound to a 
specific protein in the cytoplasm of a ceil in order to type a cell. A monccolonal aritibody specific to the 
cytoplasmic protein binds to the protein site and is magnified by an enzyme development technique. The DNA 
of the cell nucleus may also be stained. An image analysis is made with two separate images with the stained 
DNA areas visible in one image and the optically enhanced cytoplasm areas visible in the second image. These 
images may also be combined. The cells are classified based on their morphological and/or optical markings. 
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METHODS AND APPARATUS FOR CELL ANALYSIS 
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This invention relates to methods and apparatus for cell analysis, and particularly to the measurement 
of cell object features and other parameters by image analysis, and more particularly to quantitative 
measurement methods and apparatus for DNA analysis of small cell populations. 

The methods and apparatus of the invention may be used for a wide range of diagnostic and prognostic 
evaluations of various cells, antigens, or other biological materials taken from the human body. However for 
purposes of illustration and ease of understanding, the invention will be disclosed in conjuncton with I s 
preferred use. which is the quantitative measurement of cellular DNA for the purpose of cancer diagnosis 
and prognosis. The methods and apparatus are particularly for use for interactive image analysis to analyze 
and quantify the DNA in different classes of specimen cells taken from a human body. 

The current state of the art in the pathology laboratory for measuring the DNA content of a ce» is by 
visual obsen/ation. A pathologist obsen/es through a microscope primartly the shape and textjre o 
suspected cancer cells and then classifies the cells into a normal category or Into one of severe abnomia^ 
or cancer categories. Such evaluations are very subjective and can not differentiate and precisely quanbfy 
small changes in DNA within individual cells or in very small populaUons of abnormal ce Is. These smaH 
changes may represent an incipient stage of cancer or a change in cell structure due treatment of the 
cancer by chemotherapy or radiation. Such small changes are. therefore, important in the diagnosis and 

'''°^l^owev°er.*'thradl7mage in diagnosis and/or prognosis of abnormal ploidy distributions that a pathologist 
viewing a specimen under a microscope has is the discerning expertise of a skilled person m classifying 
cells as normal or abnormal. There is an innate human ability to make relatively quick infinite gradations of 
classification, i.e.. almost normal, slightly abnormal, etc. On the other hand, the classification and •neasure- 
mint o^ cell features and parameters manually by a pathologist on a cell-by-cell basis is extremely tedious 
and time consuming. Statistical analysis of such cell data taken by hand is relatively difficult because each 
record has to be entered and then processed. For different records, taken at different times, and under 
varying conditions broad statistical categorizations may be unreliable. - 

The alternative is automated cell analysis where the pathologist uses specialized equipment to perform 
the analysis. In automatic cell analysis, such as that accomplished by a flow cytometer. mass tests are 
performed in gross on a soecimen cell population without a researcher being able to exclude or include 
Srtain data o? the population. The specimen is measured "as is" without really knowing what cells are 
being measured and how many. Important single cell data or data from relatively small groups of cells are 
lost in the overall averaging of a specimen. Further, relatively large amounts of a specimen have to be used 
to orovide results from these tests and the sample is consumed. 

Although there are commercially available general purpose flow cytometers. they are very expensive 
and can handle only liquid blood specimens or tissue disaggregations. These cytometers are incapable of 
working on standard tissue sections or using conventional microscope slides which are the preferred 
soecimen forms of pathology laboratories. Additionally, a flow cytometer does not allow for the analysis of 
morphological features of cells such texture, size and shape of cell nuclei and alterations in the nuclear-to- 

cytoplasmic ratios of cells. _ . , ., 

One known apparatus provides means for displaying on a video monitor an image of a group of cells 
from a field of a microscope slide. The image is further digitized and stored in a memory of the apparatus. 
From the digitized image, a processor means identifies each possible cell object automaticaUy by a pattern 
recognition technique. An interactive program allows the operator to point to each object or cell in 
succession and make morphological decisions for classification and measurements concerning each. Fo^ 
quantitative DNA analysis, the measurement is of the optical density of the ceil object and the classif cation 
Ts by a pathologist as to whether the cell appears normal or cancerous. The decisions include whether to 
accept or reject a particular cell for further measurement and processing. The cell object, if selected, can 
then also be classified into one of several classifications for later statistical analysis. The apparatus further 
has means which permit the classification and storing of more than one image. 

When the apparatus is used for DNA analysis, tissue and cell specimens are applied to a slide which is 
then stained with a specific stain that combines proportionately with the DNA and essentia ly renders 
invisible the remainder of the cell so that the image analysis apparatus can measure the optical density of 
the DNA which is concentrated in the nucleus of the cell. The stain associates with the DNA to Provide a 
detailed nuclear structure and pattern which may be visually observed and interpreted by he pathologist 
using the apparatus for olassification. The amount of DNA in the malignant cells is substantially greater than 
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that for normal cells because the malignant cells are usually dividing and replicating rapidly or the 
malignant cells have abnormal numbers of chromosomes or have defective chromosomes. 

The apparatus can not only detect minute alterations in the nucleus by providing a real and accurate 
measurement of the DNA mass in picograms but also can measure and quantify the amount of DNA and 

5 relate it to stored statistical analyses to aid in diagnosis. More specifically, the apparatus allows an iterative 
analysis of specimen population cells and provides a histogram or other statistical display of the population 
distribution of the cells with respect to their DNA content and with respect to a standard DNA for normal 
cells so that subtle shifts in population distribution can be readily understood. To this end ceil nuclei images 
are not only acquired and stored but the data therefrom can be integrated with other statistical data to 

10 provide multivariable analysis, discrimination of cells, histograms, and scattergrams of cells or cell 
populations. 

While the methods and apparatus described above are extremely advantageous and advance the art of 
anueploidy analysis by image processing, they are not as sensitive as they could be. With the progress in 
measuring the quantity and distribution of DNA in a cellular population, there has come the need to further 

75 refine and sensitize that analysis and characterization process. One area in which sensitivity of the above 
described process can be improved is in the operator classification of ceil types. 

The previous apparatus relies mainly on the pathologist or operator to make a subjective judgement 
concerning the classification of cell types, and whether they are to be classified at ail. This is a principal 
advantage of the apparatus where the expertise of the pathologist in discerning cell types is automated and 

20 measurement of specified parameters of the chosen cells is accurately made. However, it has been learned 
that different cell types which are really quite different structurally appear morphologically similar under the 
microscope. 

This is particularly true when the nuclear DNA has been enhanced by Feulgen staining. Such nuclear 
staining is for the purpose of enhandng the optical characteristics of the nuclei of the cells which contain 

25 the DNA. but that necessarily de-emphasizes the visual characteristics of the cytoplasm in the rest of the 
cell outside of the nucleus. The result is to allow easier image analysis and precise measurement of the 
DNA of the nuclear material, but at the same time this enhancement causes the loss of the visual 
morphological characteristics of the cytoplasm which a pathologist might use to distinguish one type of cell 
from another. Additionally, there are different cell types, which it is advantageous to classify separately, but 

30 which provide no or only faint visual clues as to their differences. 

Thus, there is the need to alert a pathologist classifying the cell populations for DNA analysis with the 
known apparatus about the different cell types, whether by optical enhancement or otherwise. A more 
definitive mechanism would be the use of some demonstrable marker on the cells themselves by which the 
pathologist can objectively separate the various cell types. There are known in the art many optical 

35 enhancement or marking techniques for cell populations. 

For example, since the advent of monoclonal antibody production, numerous antibodies have been 
developed which are specific for cellular components, either in the cytoplasm, nucleus or on the ceil 
membrane. Some have already been used to type cells in pathology to assist in the definition of the cell of 
origin of a number of tumors where subjective morphology is equivocal. 

40 Among the most notable of these antibodies are antibodies to leukocyte Common Antigens, which 
identify inflammatory cells, and antibodies to a family of cytoplasmic structural proteins called cytokeratins 
which identify cells arising from epithelial structures. Other antibodies to cytoplasmic components such as 
intermediate filaments can be utilized to identify cells which provide structural support, the so called stromal 
cells. In addition, numerous antibodies exist which are more specifically related to individual tumor types. 

45 However, further optical enhancement of the cytoplasm for different types of cells is problematic in view 
of the current DNA staining technique. There are many difficulties, the least of which is that an optical 
enhancement factor for the cytoplasm should be compatible with the present imaging techniques using 
computer analysis of optical density and be required to provide such compatibility without impairing the 
sensitivity of the imaging techniques for the present nuclear staining. 

so Chemical compatibility with the present Feulgen staining technique also presents a major hurdle. 
Optical enhancement of the cytoplasm after Feulgen staining of the DNA is substantially unavailable 
because the Feulgen process is destructive of the cell cytoplasm and changes the way it appears normally. 
However, prior optical enhancement of the cytoplasm is equally as difficult because the Feulgen staining 
process is caustic with the use of highly acidic reagents which can easily destroy other optical enhance- 

55 ment factors. Moreover, if done prior to Feulgen staining, the optical enhancement pnDcess of the cytoplasm 
cannot affect the nuclear material in a manner such that the result of the subsequent Feulgen staining will 
be changed. 

According to this invention there is provided a method of analyzing a population of cell objects for a 
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given parameter, characterised by the steps of optically enhancing the population of celt objects for said 
parameter: optically marking selected ceil objects In said population for a particular eature; providing a 
magnified image of the cell objects in said populaUon to a user-observer through diglta .mage processmg; 
and qating cell objects of the analyzed population into one of several subpopulation classificaUons based 
upon morphological criteria of the cell objects and said optical markings as viewed by the user-observer. 

Also according to this invention there is provided a method of marking selected cell objects m a 
population and for measuring the DNA mass of predetermined classes of cell objects in the population 
Characterised by the steps of first staining the cell objects in the population with an 
technique including a monoclonal antibody specific to a protein in at least one of the ceH objerts hereby 
marking any cell objects Including said protein as to type: and second, staining the DNA in all «ie cell 
objects in tiie population witii a Feulgen technique. . . , , ^=ii 

Further, according to this invention there is provided an apparahis for tiie analysis of ^ Pluralrty of cell 
Objects on a support which have been optically enhanced by the enhancement of the nuclear DNA of the 
cell objects by a Feulgen staining technique and the enchancement of ttie location and content of specific 
protein sites of the cell object by an immunohistochemlcal staining technique, charactensed by means for 
magnifying an image of the cell objects; means for filtering said magnified Image at a band of wavelengttis 
where said areas of DNA staining are relatively opaque when compared with said areas of im- 
munohistochemlcal staining to provide a first filtered image; means for filtering said magnified image at a 
band of waveientfis' where said areas of immunohistochemlcal staining are relatively opaque when 
compared to said areas of DNA staining to provide a second filtered image; means for digitizing and stonng 
said first filtered image and said second filtered image; means for combining said first filtered .mage with 
said second filtered image such Uiat cell objects having areas of immunohistochemlcal staining are 
marked:means for displaying said combined image to an operator: means for gating each of the cell objects 
into one of several classification based on morphological criteria of tiie areas of DNA staining and marked 
areas of immunohistochemlcal staining: and means for measuring . the DNA mass of each of said cell 

objects and classifications of cell objects. ..... ^ ^ 

From ttie digitized DNA areas, tin© imaging apparatus identifies each possible cell object automatically 
by a pattern recognition technique. An interactive program allows a patiiologlst to point on the video monitor 
to each identified object or cell in succession to make decisions for classification and measurements 
30 concerning each. The marked cells can be specifically excluded from a subpopulation by the classification 
process or specifically included. They may furtiier be identified as to DNA content in a separate 

class^ficahon^_^_ tiie marking or identification of certain types of cells by an immunohistochemicai 
technique witii DNA Feulgen staining, tiie ability to perform DNA content analysis witti a greater degree of 
35 accuracy and sensitivity is enhanced. This greater sensitivity provides at least two more avenues of 
diagnostic and prognostic utility for human tumors. In one metinod, ttie immunologic marking can be used to 
mark which of the cells of a particular population are not derived from the tumor, leaving the remaining cells 
which are not marked immunologically to be analyzed for DNA content This metiiod is advantageous where 
a moderate number of inflammatory cells are present in a hjmor. Thus, using an antibody to leukocyte 
common antigen, tiie immunological marking can identify ttiese inflammatory cells so ttiey can be excluded 
from the DNA assay. Alternatively, when the tumor cells are relatively rare and non-tumor cells make up ttie 
majority of the cells available for analysis, using immunohistochemicai marking which specifically identi y 
tumor cells provides a much easier and more sensitive determination of DNA mass for a cell population In 
this case antibodies to cytokeratin are utilized to identify epithelial derived tumors such as carcinomas The 
analysis will tiien be focused on ttiese call types while discarding cells negative for cytokeratin as being 
inflammatory or support cells. 

One specific embodiment of the invention includes staining of tiie cell population with an alkaline 
phosphatase technique utilising a monoclonal antibody against a specific cytoplasmic antigen. The resutting 
stain is substantially specific to ttie cytoplasm and does not stain tiie nucleus of the cells. A Feulgen 
staining process using Thiomin is ttien performed to stain the DNA in ttie nucleus of each cell. The alka^ne 
phosphatase staining metiiod is used because of its compatibility with «ie Feulgen staining technique The 
alkaline phosphatase staining is specific to tiie cytoplasmic antigen binding tiie chosen monoclonal antibody 
and does not harm ttie nuclear material so ttiat it may receive the Feulgen stain in a subsequent step. The 
alkaline phosphatase staining is accomplished first before ttie destiruction of the cytoplasm by the Feulgen 
staining technique. The chromogen chosen for tiie staining technique is a fast red dye which is advanta- 
qeous for two reasons. In ttie first instance the fast red dye which is precipitated is not susceptible to being 
wasted out by ttie Feulgen stain process and ttius will remain for ttie optical visualization. The second 
reason is tiiat tiie chromogen provides excellent optical separation from the blue Thionin dye used in the 



40 



as 



50 



55 



4 



EP 0 317 139 A2 



Feulgen staining process. 

Thus, the invention provides methods and apparatus for making a quantitative ploidy analysis of cells 
using image pattern recognition equipment 

The invention will now be described by way of example with reference to the drawings, in which:- 
5 Rg. 1 is a pictorial representation of an apparatus in accordance with the invention; 

Rgs. 1 A-1 D illustrate different histograms for anueploidy analysis; 

Rg. 2 is a functional block diagram of the apparatus illustrated in Rg. 1 which is adapted to perform 
methods for the quantitatiori of nuclear DNA in accordance with the invention: 

Rg. 3 is a schematic block diagram of the image acquisition apparatus illustrated in Fig. 2; 
70 Rg. 4 is a functional diagram illustrating the major operations of the system control illustrated in Fig. 

2; 

Rgs. 5 and 6 are top perspective and cross-sectional views, respectively, of a slide particularly 
adapted for use in the apparatus illustrated in Rg. 1 and having separate areas for calibration ceil objects 
and specimen ceil objects; 

75 Rg. 7 is a pictorial view at the microscopic level of the binding effects of a monoclonal antibody; 

\ Rg. 8 is a graphical representation of the % of light transmission as a function of light wavelength for 

two stains and two color filters used in a method and apparatus in accordance with the invention; 

Rgs. 9. 10 and 11 are pictorial representations of images of a cell population showing an unfiltered 
image, a red filtered image, and a blue filtered image, respectively; 
20 Rg. 12 is a functional flow chart of one preferred method of quantitating DNA for human carcinoma, 

in accordance with the invention; 

Fig. 13 is a pictorial representation of an image monitor during a selection process, illustrating 

marked cells; 

Rg. 14 is a pictorial representation of the many optical fields on the slide illustrated in Rgs. 5 and 6; 
25 Rg. 15 is a pictorial representation of the calibration screen which appears on the instruction monitor 

illustrated in Rg. 1 ; 

Rg. 16 is a pictorial representation of the analysis screen which appears on the instruction monitor of 
the apparatus illustrated in Fig. 1; 

Rg. 17 is a system flow chart of the screen architecture of- the apparatus illustrated in Rg. 1; 
30 Rg. 18 is a functional flow chart of the main menu of the main screen illustrated in Rg. 17; 

Rg. 19 is a functional flow chart of the calibrate menu of the calibrate screen illustrated in Rg. 17; 

Rg. 20 is a functional flow chart of the adjust blue boundary menu of the adjust blue boundary 
screen illustrated in Rg. 17; 

Rg, 21 is a functional flow chart of the adjust red boundary menu of the adjust red boundary screen 

35 illustrated in Rg. 17; and 

Fig. 22 is a functional flow chart of the analysis menu of the analysis screen illustrated in Rg. 17. 

The apparatus illustrated in FIGS. 1 and 2 and the methods described herein can be used to develop 
histograms, and other statistical data, of cell populations for the diagnosis and prognosis of malignancies 
40 and other diseases. Specifically, the quantity and distribution of nuclear DNA in separate or combined 
classifications of cell populations is available. To illustrate the utility of such statistical analyses reference is 
directed to FIGS. 1A-1D. 

Refemng now to FIG. 1A there is shown a normal ploidy histogram having a typical ceil number versus 
mass distribution for healthy, non-dividing cells. The number of cells is provided on the ordinate axis and 

45 their nuclear DNA mass on the abscissa. If the cell population shown in the figure is not dividing, the DNA 
content should be peaked around a normal peak G0/G1 which is the diploid amount, 7.18 picograms/cell. 
This relative mass of DNA is labelled as 1.0 to normalize the abscissa of the histogram. FIG. 1B also shows 
a normal cell population which is dividing, such that there is a significant G0/G1 peak at 1.0 and a second 
peak G2 at 2.0. The peak at 2.0 is normal because some of the cells are in division and have double the 

50 normal diploid amount of DNA. The saddle S between the two peaks is relatively low and does not indicate 
any malignancy. 

Comparing the histogram in FIG. 1C with the first two. it is seen that this cell population is skewed from 
normal by having a higher first peak around 1.5 and a second peak around 3.0. Further, the saddle S is 
more pronounced and can be rough in cell count. This histogram may show a malignancy because of the 
55 abnormally high DNA content for many of the cells. This high DNA content is likely indicative of the 
increased ploidy amount of malignant cells which are rapidly dividing. 

Likewise, in FIG. ID it is shown that the G0/G1 peak occurs at 1.0 with a normal diploid amount of DNA 
but has a relatively large trailing saddles from 1.0 to 2.8. A normal G2 second peak is not noted and is 

5 
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indicative of an abnormal cell population. The shape of the histogram .s l.kely due to abnormal DNA 
amounts in cells and clones of cells indicative of malignancy. Therefore, from the shapes and changes .n 
cell distribution histograms, diagnostic and prognostic information can be obtained. 

DNA analysis of human cells has been shown to have both diagnostic and prognost|c ut.l.J^ for human 
tumors As with any test, its usefulness is dependent on both the accuracy and sensitivity of the technique 
eZSed fo Sie^^^^^^ «f a tumor specimen were composed only of the tumor cells the accuracy and 
srsSvfty of me illusiated technique would be a function of the DNA staining and the accuracy of the 
SLasurSi insfrument However, tumors are most commonly composed of a mixture of cell types In 
addition to he tumor cells one finds the normal tissue from which the tumor arose, supportive and structure^ 
Jerients and a variety of inflammatory cells and cells which are part of the repair and defense process of 
Se host ?iese cells vary in amount from tumor to tumor and may indeed numencally overshadow the 

*"T"J^mrciirie" included in «,e histograms of the DNA analysis illusti-ated. several errors can 



occur: 



1. An insufficient number of tumor cells may be identified resulting iri a tumor inappropriately being 

""'l^rtrorL w'SS ^ntrli DNA content, the norma, cells will exaggerate the peak on the histogram 
where tiie resting tumor cells appear and artifactually lower the percentages of proliferating tumor cells; 

flf tS nonTrlioTcel^ are proliferating, tiney will give an artifactual elevation to the 

assessment of proliferating activity in the tumor. 

Thus, an improvement to the DNA analysis could be made witfi a mechanism to ^PP-j^P j^^^'^ ^"'"^^^^ 
irrelevant cells. Among tiie potential mechanisms are to attempt to distinguish tumor cells from non-turno^ 
SCc^S size^d shape characteristics, eitiier quantitatively or by subjective morphologic assessmerrt 
by a pathdogist The qualitative method is not useful in tt^at tumor cells ttiemselves can va|7 signmcantly 
in skra and shape and tiiere is substantial overlap between tiiese parameters in tumor cells and ttiose seen 
in m?nor^tumor type cells. The subjective morphologic metiiod is more useful in that it takes into account 
lite dia7ostic criteria. The present apparatus takes advantage of this by ^^^^^ 
his subjective skills to separate the tumor cells from tiie non-tumor cells for DNA analysis. One problem is 
Tat £ pttroloS^t^aJti^^^ uses characteristics of botii the nucleus and the cytoplasm to make th^e 
Sjecir uS^^^^^^^ However, when dealing witi. tiie previously disclosed method of ^"J^ysis or^ the 
nuc eurrs Itained making any morphologic assessment more difficult. The invention solves this problem by 
Te oSc^ enhancement or L maricing of selected cells, which exhibit a certain characteristic or type to 

''"^hLTnl^tion Shown. «,e system is a computerized image -lysis system de^^^^^^^^^^^ 
me^ure a number of cell object features and parameters from tiielr image on a typical glass slide. The 
"stmm'n? inc'des a sophisicated digits image processing system controlled by ^o^jj^^^^^ - 
quantitative analysis on individual cells for nuclear DNA content by Feulgen staining as well measure 
mert 5 other nuclear features. The imaging system couples tiie ability of a pattiologist to identify and 
Sas if? cXto be studied witii tiie capability of computer enhanced, high resolution digital video image 
n7oi?sing to quantify optical and stain density accurately. Further, the system optically marks certain types 
S cTSc^tSat S^^ paLogist in making his classifications can include or exclude them from the study to 

impiove the sensitivity of the process. o=,«oia i« fir^ 

in general, a patinologist first prepares a needle aspirate preparation of fresh tissue. The sample .s hrs^ 
stalled wim a alk^ine phosphat^e technique using a monoclonal antibody specHic against an antigen in 
tht Telluterc^plasm. The nuclear DNA in the sample is ttien stained by tiie Feulgen technique using 
TOonSt tSfdye or optical enhancement factor. After fixation and staining, the preparation is ready for 

^"^'Se operator has the option of classifying the cells morphologically into any one of six categories or 
rejecting inappropriate cells or debris. The cell data are processed by a system control and the cellular 
eSS are characterized by a quantitative DNA analysis for each cell class. The mforma ion when 
impTred w^ eittier a stand J!i ce? calibration or published data allows a patiiologist to accurately quantify 
and classKy abnormalities ttiat might ordinarily be described only verbally from the image. 

The addition of quantitative data enables pattiologists to perform ttieir work m a more standardized and 
reproducible manner. The system is of value in classifying lesions that may be "^^'IS"^" . ^"f P^l'^"; 
prognostic information for known malignancies based on DNA content. The irnage identification syjem s 
more advantageous ttian common flow cytometry metiiods of evaluating DNA content. Flow cytometry 
permits a^ operator to classify neoplastic cells based only on cell markers. The pathologists, however. 
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never sees the cells that the Instrument has examined. In addition, the cell preparation must be used in a 
short time frame and is consumed in the course of the study. Although a permanent section of a tumor 
under study may be examined at the same time, there is no guarantee that the same cells are examined in 
both areas. Also the quantity of tumor available may not be large enough to permit a flow cytometric 

5 examination. * p^ma ' ^ 

In the apparatus the quantitative DNA analysis is performed rapidly for the measurement of DNA and 
ploidy distribution pattern in a cell population under study. The pathologist advantageously selects the cells 
which are to be used in 'the population measurements. The measurement of DNA content is useful and 
believed to be relevant in diagnosing and determining prognosis for a variety of tumors that involve the 

10 breast. colorectum» and prostate. The system takes advantage of the skill of the pathologist and the 
selected cell marking to visually identify and classify abnormal cells, and then uses the computer aided 
Imaging analysis to analyze quantitatively those particular cells selected for the parameters desired. Such 
instrument advantageously extends and augments the recognition and diagnostic skills of the pathologist. 
With reference to Rgs. 1 and 2 of the drawings, the invention is embodied aa an apparatus 11 {Fig. 1) 

75 which functionally operates as a digital image analysis and processing system 13 (Rg. 2). The apparatus 1 1 
comprises a high resolution microscope 15 with which an operator can view magnified specimens on a 
support, in a preferred embodiment a glass slide 14. The microscope 15 includes adjustment or positioning 
means 70 for focusing its optics 16 on the slide 14 and a platform 51 movable incrementally in X and Y 
directions via positioning means 12 and 17 in order to view different areas thereof. Positioning means 12. 17 

20 and 70 are the form of mechanical adjustment verniers which are conventional for instrument quality 
microscopes. . . 

The specimens in the field under study are further viewable by the imaging system 13 via image 
acquisition apparatus 18 (Rg. 2). The apparatus 18 receives the light intensities of the image of the field 
and converts them into two analog signals (Red. Blue) which can be sampled and processed by the image 

25 analysis system 13. The image analysis system 13 is controlled by a system control 22 in the form of a 
digital processor such as a personal computer. 

An operator, such as a pathologist or laboratory technician, can interactively communicate with the 
system control 22 via a keyboard 36. and interacts further with the system to quantitate nuclear DNA and 
classify cell objects by the viewing of two displays or monitors. A first display, image monitor 37. is a, 

30 conventional RGB video monitor which displays through the system control 22 and the image acquisition 
apparatus 18. the same image field as seen through the microscope 15. A second display, instruction 
monitor 62, is another conventional RGB video monitor and is used to provide the operator with interactive 
prompts, messages, information, and instruction screens from a system program executed by the system 
control 22. 

35 The keyboard 36 is preferably a conventional AT type keyboard which has on tiie left-hand side a 
plurality of function keys F1-F10. in the middle a plurality of alphanumeric keys including the special keys 
of ENTER. SHIFT. CONTROL, and ALTERNATE, and on the right-hand side cursor control keys including 
up. down, left and right arrow keys, a numeric keypad, a numeric lock key. and an escape key. A keyboard 
interface 35 translates the keystrokes of the operator into numerical codes recognized by the system 

40 control 22 for specific key indications. A printer 38 is provided for producing reliable hard copy output of the 
statistical data and reports produced by the apparatus 1 1 . 

A functional schematic of the apparatus 11 is illustrated in FIG. 2 as image analysis and processing 
system 13. The image processing system 13 is used to analyze a plurality of specimen cell objects on the 
support or glass slide 14 of the microscope 15. Suitable high resolution microscope optics 16 receive light 

45 from a variable intensity source 19 and transmit the light through the slide 14, 

Because the source 19 transmits light through the cell objects on slide 14. the optical density of each 
pixel of the image will convert the light into a different intensity depending upon its percentage of 
transmission. Areas with no cell objects in them will appear relatively light or intense and areas having 
nontransmissive objects will appear darker. In general, unmodified cell objects are relatively transparent and 

50 their features difficult to distinguish. Staining the cell objects allows an optical enhancement of the features 
stained so they will appear darker than other features and their background. 

The optical image of each of the cell objects on the slide 14 passes through an optical image splitter 
25. On one side of the splitter 25, the image acquisition apparatus 18. or other detector, converts the optical 
images point by point into two scanned electronic signals (Red. Blue) representing a monochromatic 

55 representation of the optical intensity of each point in the image on the other side of the splitter 25. a true 
color image of the field is provided to the operator by viewing optics 24. 

Rg. 3 illustrates the optical filtering and splitting of the image performed by the image acquisition 
apparatus 18. The focused image fomied by the light intensities is transmitted substantially vertically 
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through the slide 14 and enters the beam splitter 25 mounted in a holder 53. The first true color image 
passes vertically therethrough. A second true color Image is further transmitted by the beam splitter 25 
oerpendicular to the vertical path through the focusing lens 154 to image acquisiton apparatus 18. The 
image acquisition apparatus 18 comprises a plurality of optical elements including a second image splitter 
5 156 mirrors 158. 160 and 162. and two monochromatic optical filters 164 and 166. The image acquisition 
aop'aratus 18 further includes dual video cameras 168 and 170 which each receive a portion of the split 
image. After the second true color image is split from the microscope optics, it passes into the second 
be^ splitter 156 where along one path the image is reflected by minror 158 through filter 164 and imaged 
by camera 168. Along a second path, the image is reflected from mirror 160. to mirror 162. and then 
10 through a second filter 166 to be imaged by camera 170. The filters 164 and 166 are narrow bandpass 
filters substantially blocking all light frequencies outside their pass band. The images from cameras 168 and 
170 are therefor essentially monochromatic images of the field under study on the slide 14 The f>rst filter 
element 164 comprises a red filter which passes on light of a nanrow bandwidth of wavelengths near 620-10 
nanometers. The second filter element 156 is a blue filter which passes light of a narrow bandwidth of 
IS wavelengths near 480*10 nanometers. 

Each television camera 168. 170 converts the monochromatic optical images point by point into a 
scanned electronic signal representing the optical intensity of points in the image. The output of the 
cameras 168 and 170 which is formatted as a standard NTSC analog video signal is applied to an analog to 
digital converter of a pair of image processing interfaces 21. 23. Each image processing interface 21 23 
20 s^ples the analog signal from each camera 168. 170. respectively, and converte the .mage s'gnal to a 
digitized signal which is received and stored by the system control 22. Because of the contnuous scanning 
a real time image of the area that the optics 16 are focused on is provided by the image display 37 With 
the dual camera arrangement either a red color image or blue color image is avail^le simultaneously to tfie 
system control 22. In general, each monochromatic digital image is stored as a 512 x 512 anray of pixels 
25 where each pixel has a measured light intensity of 0-255 (8 bits). ^ ... . , 

Because the viewing optics 24 of the microscope 15 are located on the other side of the image splitter 
25. this parfccal an-angement allows the same image seen in the viewing optics 24 to be displayed on the 
image display 37. This feature allows the positioning of the platform 51 by the manual X. Y adjusbnent of 
posLning means 12 and 17 until the operator views a field of interest on the slide 14. At 
30 computer enhanced digitized image of the selected field is displayed on the image display 37 for fu*er 
analysis. An X position sensor 26 and a Y position sensor 27 generate position signals to a positon 
interface 34 which digitizes these signals to provide the apparatus 11 with an accurate coordinate 
reoresentation of the field in view. ^ ^ u.^ 

Both of the displays 37 and 62 are controlled by the system control 22 through standard video monitor 
interface circuitry 39 and 61, respectively. Similarly, the keyboard 36 and the printer 38 communicate with 
the system control 22 through conventional interface circuits 35 and 41. respectively. In addition, the 
system control 22 controls a random access memory 73 and other bulk memory storage in the form of 
either floppy and hard disk drives 75 through a memory control interface 71. 

All oUhe interface circuits 21. 23. 34. 35. 39. 41. 61. and 71 can be selectively embodied on printed 
circuit boards which are mounted in the backplane or card connector of a conventional personal compiler 
forming the system control 22. Preferably, the personal computer can be one manufactured by the IBM 
Corporation having a model designation AT. or those compatible therewith. Such system control 22 can be 
run under a disk operating system such as PC DOS. version 3.1 or later. The system software for the image 
analysis is called as an application program from the disk drive 75. and could for example, be supplied on a 
floppy disk 77. The system software is read from disk 77 and loaded Into RAM 73. After loading, program 
confrol is transferred to the system software from tiie operating system to regulate the various hardware 
elements of apparatus 1 1 previously set fortii in a known manner. 

The image analysis system 13 operates under an interactive program control by providing a number of 
instruction screens or images on ttie instruction monitor 62 to assist Uie operator in the quantitation of 
nuclear DNA found in one or several cell subpopulations displayed on image monitor 37. Tnrough 
interactive responses by the operator and menu selections on different instruction screens, ttie basic 
system functions of tiie image analysis are performed. . ^ , »u« 

The system functions are more fully illustrated in Rg. 4 where software control logic functions for the 
hardware in block 80 are shown communicating with software analysis and measuring functions of the 
system software in blocks 82-96. Software is included in the system to perform an initialization and an 
interfacing of the operating system functions and overall control of tfie apparatus 11 by instrument control 
logic. A screen handler for ttie instruction screens and tiie video display of the digital .mages of the 
specimen is performed for both of the monitors 37, and 62 by image and instruction monitor control logic. 
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The memory and disk storage functions are handled in the software by memory control logic. Input and 
output for the interactive responses and reports are handled by the printer and keyboard control logic. 
Further, data from the cameras 168. I70 and from the position sensors 26. 27 are handled by Image 
acquisition control logic and position acquisition control logic, respectively. 

The control logic of the software forms a operating shell which is used by the analysis and measuring 
functions in blocks 82-96 to control the hardware of apparatus 11 to perform the particular function needed. 
The system provides a patient labeling function 82 to identify the particular tissue samples which are under 
study. Ught calibration and position calibration functions 84 and 86, respectively, are used to determine a 
correct reference optical density for a particular field and the location of that particular field with respect to a 
coordinate origin. A control cell calibration function 88 provides a datum for the compensation of different 
background stainings and DNA index calibration. A boundary formation function 90 allows the operator to 
choose a reference level against which the grey scale values of an image are compared for either the red 
image or the blue image. A selected cell marking function 91 provides for the marking of those cells 
identified by the cytoplasm optical enhancement in the acquired data function. The cell data acquisition 
IS function 92 provides for the storage of the grey scale values of the measurements a specimen image. A cell 
classification function 93 allows the operator to classify the acquired cells, taking into account those marked 
cells, into different categories, and a ceil analysis function provides different statistical analyses of the 
categorized data. A utilities function 94 provides the needed auxiliary type programs for assisting in the 
primary functions of the image analysis. A report generation function 96 is used for hardcopy production of 
20 analyzed and compiled data from the system on the printer 38. 

The support on which a specimen is viewed preferably is a transparent glass slide 14 as illustrated in 
Rgs. 5 and 6. Glass slides of a rectangular shape come in standardized sizes such as 1" by 3" and such 
can be used with the following modifications. The slide 14 is partitioned into two sections where in a first 
control section 56 are located control cell objects 40, In a second section, specimen section 58. there are 
25 located specimen cell objects 52 which are to be measured for their content of DNA. The slide 14 further 
includes a border 54 around the control section 56 for rapid identification of that section. Further, on some 
convenient location of the slide 14 is placed a identifying mark 53. The mark 53. illustrated as a cross in 
Rg. 4. is used as a landmark for identifying the coordinate origin for fields on the slide. 

Because the apparatus 11 may be used in various offices such as pathology offices having persons of 
30 varying degrees of skill and knowledge about image analysis, the microscope light source 17 may be 
variously adjusted by different operators such that the background may have a different light intensity not 
only from machine to machine but also at different times depending on the age and nature of the lamp 
doing the illumination. When the cell objects are DNA nucleus, the stained nuclei appear darker and have 
high darker gray levels than the cells which have fewer or no DNA content The particular light intensity 
level is desired to be known in an accurate and real manner; and hence, it is important that there be a 
calibration of tiie light intensity to eliminate errors which might be introduced if differences in light intensity 
levels are not accounted for. 

A further problem witii widespread usage of equipment of the foregoing kind is the Feulgen staining 
factor by which is meant that tiie user may be applying eitiier a heavy amount or a light amount of the 
Thionin stain. This will result in a variation of tiie gray level being viewed through microscope 15 and by the 
cameras 168, 170 which is then analyzed as to the particular DNA content Thus, there is a need that the 
apparatus 11 be calibrated to eliminate differences because of the staining factor so as to provide a true 
indication of the actual amount of DNA. being analyzed. A calibration material 40 is provided on the slide 14 
which, when viewed by the operator under a calibration step of tiie system software allows the operator to 
45 adjust and to calibrate the apparatus prior to tiie measuring and analyzing of specimen cell objects on the 

slide 14. . 

In the illustrated embodiment of tiie invention tiiere are provided two different materials on tiie slide 14 
with the first being the control cell objects 40 which are stained simultaneously witii the staining of tiie 
specimen ceil objects 12. The simultaneous staining pemiits tiie analysis of tiie control cell objects to be 
50 compared to a predetennined stored reference light intensity, gray level, or optical density which the control 
cell objects 40 have after staining. If tiie cell objects are stained either too lightiy or too heavily, the amount 
of understaining or overstaining can be quantitatively analyzed and adjusted for as will be described 
hereinafter. 

The control cell objects 40 are. in tiiis illustrated embodiment of tiie invention, rat liver cells of a known 
55 size and shape, and DNA content. The control cell objects 40 may be otiier types of cells having dark 
centers or nuclei which stain well, such as chicken blood cells or trout cells. On tiie other hand, the cell 
objects 40 may be artifacts printed on the slide to have a cell shape. Furthermore, as above explained, tiie 
cell objects 40 may be conventional plastic beads of a predetermined size which will react witii a particular 
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fluorescent stain or enzyme stain when treated simultaneously with specimen cell objects such as 
monoclonal antibodies used In the specimen area 58 of the slide. The reference ceil objects will vary from 
test to lest and the present invention is not limited to any particular test or cell objects. 

A oatholoQist will take a slide such as shown in FIGS. 5 and 6 having premounted thereon the confrol 
5 cell objects 40. and add thereto the specimen cell objects 52 which are. In this Instance, ceils from a needle 
aspirate of tumor tissue or monolayer of blood cells or other cells, at the area 58 on the shde. The 
pathologist will then stain or otherwise treat simultaneously the control cell objects 40 and the specimen cell 

obiects 52 for image enhancement ^ , „ ac 

A tat .s provided with the apparatus 11 which contains the slide 14 with the control cell objects 40 
,0 thereon, and bottiss of reagents which are needed for the dual staining technique. For alkaline 
Phosphatase staining technique the kit contains bottles of a primary antibody reagent, a biotinalated 
secondary anubody reagent, an Avidin-Biotin. alkaline phosphatase reagent, and a chromagen subs^ate 
(preferably fast red). For the Feulgen staining technique the kit contains bottles of Thionin reagent solution. 

,s ^""^ToZv^Ta »t.de 14 tor analysis, the following process is used. The slide 14 having control cells in 
section 54 «^ ^p«c«T,en ce(is in section 58 is first stained with the alkaline phosphatase technique to 
optically tH-wirK- . cytoplasmic antigen The immunohistochemical staining begins with a nonflxed 

soecimen M .s initially cold fixed at 40*C. in acetone for 20 minutes. The slide is then 

rinsed tw.ce n . prov:r«te ouHered saline solution for five minutes (each rinse) without allowing the slide 

*° "^The saoe u I- then .ncubated for 15 minutes at 37* C. in a moist environment with a solution of 2 ml. 
to which has aac^a 10 drops of normal horse serum. This step prevents much of the nonspecific 

bindinq of trw ontibocjy to sites of the cell objects. .... ^ ^ ^ ^r, 

Atter draif^-ng ir« excess cf the nonnaJ horse serum solution^off the slide 14. it is incubated 15 minutes 
25 at 37* C. in a mo-st cnvironmont with the primary antibody which binds to the antigen in the cytoplasm of 

the ^^°^^!^^;^ ^^^^ i„ 3 phosphate buffered saline solution for 3 minutes (each rinse) 

without allowii^ tho sfide to dry. Next, the slide is incubated for 15 minutes at 37 C. in a moist environment 
with biotinalated bodging antibody solution. The dilution of the antibody solution being 1:400. The slide is 
30 aaain twice rinsed m a phosphate buffer saline solution for 3 minutes (each nnse). 

Thereafter for development and magnification an AvkJin-Biotin. alkaline phosphatase solution is in- 
cubated with the slide 14 for 15 minutes at 37* C. in a moist environment. Solutions of A-B complex and 
alkaline phosphatase solution are available from the Vector Corporation of Burlingame California, as 
solution A. and solution B of kit number SK-SIOO. 50 microliters of solution A and 50 microliters of solution 
B is mixed with 5 milliliters of a 1% Bovine serum albrumin/phosphate buffered saline solution to form the 

development solution. . ^ , . . . . 

The slide is again rinsed twice in a phosphate buffered saline solution for 3 minutes (each nnse). A 
chromogen substrate is then added to color the developed precipitate. Preferably, the substrate is red dye. 
fast red. from the same kit as above which contains dye solutions 1. 2. and 3. Two drops each of solutions 
1 2 and 3 are added to 5 milliliters of 100 mM TnS with a pH of 8.2. This solution is incubated with the 
slide for 15 minutes at 37* C. in a moist environment The final step in the cytoplasm development is to 
rinse the slide for 1 minute in distilled water. , »u i 

The slide 14 is then stained with the Feulgen technique using Thionin to optically enhance the nuclear 
DNA of each cell The slide 14 is fixed in 10% by volume buffered formalin, adjusted to a pH in the range 
of from about 7 2 to about 7.5, for 10 minutes at room temperature. The nuclear DNA of the cell objects is 
then hydrolyzed by treating the slide 14 for about 60 to 75 minutes in 5N hydrochloric acid. The staining 
process is accomplished on the slide by transferring it to a Thionin solution for about a one hour penod. 
Afterward the slide 14 is washed in a three state process of rinse solution. The slide is placed in a first 
stage of rinse solution for about 30 seconds, transferred to a second stage of rinse solution for about 5 
minutes, and then pemiitted to stand in a third stage of rinse solution for about 10 '^'""teS; ^ lide is 
subsequently washed for about 5 minutes in running distilled water, and thereafter washed with acid a^coho 
(0 37% hydrochloric acid. 70% ethanol) for 5 minutes. The slide 14 is then dehydrated in absolute ethanol 
for about 5 minutes to prepare it for coverslipping. Finally, the slide is cleared in xylene for about 5 minutes 
before being mounted with a synthetic resin and coverslip. 

In Rfl 7 there is shown a representative drawing of the marking and amplification of a particular antigen 
site 180 labelled AR. The site is an antigenic against a primary antibody 182 that binds thereto. In the 
preferred embodiment a bridging antibody 184 against the primary antibody is used to bind to the primary 
antibody and has affixed a Biotin molecule 188. To the bound primary and bridging antibodies is added 
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Avidin-Biotin complex including an Avidin molecule 186 and three Biotin molecules 188. These Biotin 
molecules 188 are conjugated with molecules of alkaline phosphatase AP enzyme 190. TTie fourth Biotin 
molecule site is open to binding the complex to the bridging antibody 184. The site, when a dye such as 
fast red molecules 192 in solution is added to this mixture, the alkaline phosphatase reacts with the dye 
molecules to produce insoluble fast red molecules 194 which mark the antigen site. While the Avidm-B.otin 
complex is exemplary and preferred, any number of different marking techniques can be used. Alter- 
natively, a bridging or primary antibody which is anti-alkaline phosphatase can be used, and then amplified 
by fast red dye in the manner previously described. . ^ u *u m 

A dual filtering method is thereafter applied to distinguish the areas (cytoplasm) stained by the red 
chromagen and the areas (ONA) stained by the blue Thionin These images, one by the red filter and the 
other by the blue filter, are used to separate the DNA stained areas from the cytoplasm areas containing the 
specific antigen, and to separate both of these areas from other cell or field features. , ^ . 

The results and desirability of this dual filtering of a stained cell image are more fully illustrated in Fig. 
8 The percentage of light transmitted through the nuclei stained with Thionin dye is shown in the curve A 
as a function of the wavelength of light The percentage of transmission of light for fast red dye is sliown in 
curve B as a function of the wavelength of light. The bandwidth of wavelengths of light passed by the blue 
niter is illustrated in band C while the bandwidth of wavelengths of light passed by the red filter is illustrated 

''when' a true color image of a cell population or specimeH is filtered with the blue filter 166. substantially 
all of the areas stained with the fast red dye will be invisible and substantially ail the areas stained with 
Thionin dye visible. This is because the Thionin curve A has a relatively nontransmissive peak near this 
wavelength band (480 nms.) while the fast red curve B is relatively transmissive in this band. Thus, in this 
manner the areas with Feulgen stain can be separated from the cytoplasmic areas. At the other extreme of 
the graph the band D of the red filter 164 is positioned at a place where just the opposite occurs. The 
Thionin curve A is relatively transmissive in this bandwidth while the fast red curve B is relatvely 
nontransmissive. Thus, the cytoplasmic areas containing the fast red dye can be identified without a 

"'""eeTause of the opposite relative differences in light transmission between the two stains in the two 
filtered bandwidths. the Thionin stained area is enhanced during one filtering relative to other areas of the 
cell and the fast red stained areas are enhanced relative to other areas of the cell dunng the second 
filtering While the implementation shows a convenient and advantageous method for discriminating 
between the two areas having separate staining, it is recognized that there are various other staining or 
optical enhancement methods and filtering methods which can be used to optically enhance one particular 

area or feature over another cell area. • • 

The system software for DNA analysis can now determines the mass of the cellular DNA by obtaining 
the optical density of the specimen cells from the Thionin stain via the instrument 11. In general, the mass 
of the DNA of a stained cell object can be obtained from its optical density by utilizing the Beer-Lambert 
Law which is well known in the art of microspectrophotometry. The equation states: 
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where 

M = mass of the object in picograms 
a - Spot size In um^ 

E X = extinction coefficient of the stain at wavelength X in um^/pg. 
OD = optical density of each spot (dimensionless) 

^° The instrument uses tills law to find the mass distribution of a number of cells or cell objects which can 
then be analyzed according to a statistical basis, histogram, or otiier analytical format as will be discussed 
hereinafter. The spot size « is determined by tfie number of pixels which are measured by ttie camera 18. 
The optical density for each pixel is calibrated by adjusting tfie light level, focus, and reading a reference 
optical density from the calibration area on the sHde. This calibration allows the conversion of the measured 
light levels for each pixel into an optical density, a dimensionless quantity. 

A calibration for the extinction coefficient is accomplished by measuring ttie optical density for a 
plurality of the control cells 40 to detemiine a peak for tiie distribution in relative mass units. Because ttie 
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peak DNA content is known for the control cell distribution, the cells in the measurement field can be 
measured using the relative OD units and then converted directly Into picograms by using the control cell 
calibration For example, if the control cells are known to contain pg of DNA (rat liver cells) and a group of 
calibration cells show a peak distribution of 11.000 relative OD units then a normal group of human cells 
(with a known DNA content of 7.18 pg.) would exhibit a peak in their distribution at approximately 13.250 
relative OD units. Further, any other relative OD unit measurement can be converted directly into picograms 
by determining and using the extinction coefficient found from the group of calibration cells. 

The method is combined with this technique as will now be more fully described with respect to Rgs. 
9-12. Figs 9-11 are pictorial representations of the true color image of a field of a slide 14 (Rg. 9), an 
image filtered with the red filter (Fig. 10). and an image filtered with the blue filter (Rg. ll). Rg. 12 Is a flow 
chart of the steps in the method to produce quantitation of nuclear DfMA. 

In Rg. 9 there Is illustrated several cells of a subpopulation from one of the fields of the microscope 
slide 14 The subpopulation contains different types of cells, wherein specific cells 202. 204 have been 
optically enhanced by the alkaline phosphatase staining. All the cells 200. 202. 204. 206. and 210 have had 
TS the DNA in their nuclei optically enhanced by Feulgen staining with Thionin dye. 

When filtered with the red filter In Rg. 10, only those areas which contain the fast red dye are visible. 
These are the cytoplasmic areas 212, 214 of cells 202. 204 respectively which have been optically 
enhanced because they contain a specific antigen which binds the monoclonal antibody of the alkaline 
phosphatase staining. This type of cells 202. 204 are different from the cell types 200. 206. 208. and 210. 
20 which are invisible in this image. Further, the nuclei of all cells 200. 202. 204. 206. 208. and 210 can be 
made invisible in the background because of the optical separation of the Thionin dye and fast red dye. 

In Rg 11 there is illustrated the result from the blue filter, where all the nuclei 216. 218. 220. 222. 224. 
and 226 from the cell population are visible. The image filtered with the blue filter produces an exclusion of 
those cytoplasmic areas which are not nuclear stained (clear rather than stained), and which are optically 
25 different (fast red stained) even if stained. ... ^ _ , • 

The areas stained above the thresholds set for each filtered image can then be combined by overlaying 
the DNA image on the cytoplasmic image digitally to present on the monitor a clear image of the DNA 
nuclear areas for typing and analysis where certain cells 202. 204 are marked clearly as to type by an 
Identifying cytoplasmic ring or crescent on the nucleus Rg. 13. The DNA analysis then proceeds by tlie 
interactive classification of each cell in the image displayed on the image monitor 37. The specifically 
marked cells 202. 204 can be included in any class, excluded from any class, or classified entirely 
separately from any other class. Further, it is evident that different optical enhancements and filtenngs will 
give rise to different typings and increase the sensitivity of the classification process. 

The method of measuring and analysis of nuclear DNA using the marking technique is more fully 
illustrated in Rg. 12. In a first step, in block 250, a slide 14 containing control cell objects and specimen cell 
objects is stained with the alkaline phosphatase technique using fast red dye. The monoclonal antibody is 
specific against a cytoplasmic antigen, for example. Leukocyte Common Antigens or Cytokeratins The next 
step in the process is to stain the slide 14 with the Feulgen process using Thionin in block 252. After 
mounting, the slide 14 is placed on the platform 51 of the instrument 11 and the operator positions the slide 
40 14 such that a clear field is shown on the image monitor. The light level is then set for the instrument in 

block 254. ^ , ^. ^ ^ , 

The platfonn is then moved to the control cell area where an image of a subpopulation of the control 

cells appears on the monitor 37 in block 256. This image is the filtered image (red) showing only the 

Feuglen staining. The amount of staining to determine the DNA index, such that mass can be determined 
45 from optical density, is found by measuring optical density of the control cells in block 260. Normally, more 

than one field of control cells is measured to obtain an accurate measurement and this step can be 

repeated by looping through block 264 and block 262. In block 262. the operator moves the platform 51 so 

that another field of control cells comes into view. 

The measurement of the peak of the optical density units is converted into the DNA index and stored, 
so The instrument may now be used to measure and analyze the DNA of specific cells on the specimen 

section 58 of the slide 14. To this end, the instrument platform 51 is moved to a field where specimen cell 

objects are visible. 

Initially, a cytoplasmic image of the specimen field is obtained using the blue filter in block 266 and its 
boundary set in block 268. Thereafter, a DNA image of the specimen field is obtained using the red filter in 
ss block 270 and its boundary set in block 272. These filtered images are real time images of the field and are 
being constantly updated by the image acquisition means 18 of the system 11. The apparatus 11 combines 
the two filtered images in block 274 to mark the selected cells on the image monitor 37 while displaying the 
DNA nuclear area. The program then proceeds to a classification step in block 276. When in the 
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Classification mode the image acquisition and combination (marking) halts and a static image is presented 
on the image monitor. 

The cells in the image on monitor 37 are then classified as to type by an interacttve process with an 
operator where each call is pointed to by the apparatus, and the operator in response to the identification 
selects a classification for it using the nuclear morphology and the cytoplasmic markings of the combined 
image. The classified cells are then measured for DNA content in block 278 and the results of ttie 
measurements displayed in block 280. The display can be in various forms and statistical analyses of the 
different classifications or combinations of classifications. ^ ^, , ooo 

The measurement step can include more than the cells In one field by looping through block 282 and 
block 284. The operator moves the platform 51 of the apparatus 11 to another specimen field in block 284 
and the marking and imaging steps proceed as previously described. The data accumulated in ttie 
measuring step for the new cell population is added to that developed for the previous cell populaton s). 
The display step in block 280 can be delayed until a significant amount of data is accumulated or a display 
of each iteration provided at the option of the operator. The operator further has the option to bypass setting 
the cytoplasm boundary and DNA boundary once they have first been set for a specimen image. 

The system program for DNA quantitation is. in general, a menu driven program which allows the 
operator to interactively communicate with the image analysis system 13 to produce the quantitation of 
nuclear DNA by image analysis. The system program displays a plurality of images or instruction screais 
on the instruction monitor 62 which include menus from which to select the various functions needed for 
performing a quantitative nuclear DNA assay. Hg. 17 illustrates the screen architecture of the system and 
the paths that the system takes between screens. Examples of two of the system screens, the calibrate 
screen A14 and the analysis screen A16. which appear on the instruction monitor 62 are pictorially 
illustrated in Rgs. 15. and 16, respectively. 

Retuming to the reference numerals in Fig. 17. the system program may be run by calling it as an 
application program of the operating- system A10. Selection of the system program by the operating system 
A10 produces the main screen A12 on the monitor 62. From the main screen A12 the operator can select a 
calibrate screen A14. an analysis screen A16. or exit back to the operating system A10. White displaying 
the calibrate screen A14. the instrument can be calibrated to provide the background or reference light 
settings which will be used in the measurement of the assay. Once the light calibration is complete ttie 
operator can select the analysis screen A16 which is used to measure and classify the cell objects of the 

assay technique. ^. ^ ... , . 

One of the options in analysis screen A16 is to adjust the blue boundary which assists in forming the 
nuclear areas. Another of the options is to adjust the red boundary which produces the adjust red boundary 
screen A20. Once the nuclear and cytoplasmic areas have been bounded by the screens A18, A20. tne 
operator can select the analysis screen A16 to actually do cell measurement, classification and to generate 
reports. Exits from the adjust blue boundary screen A18 and from the adjust red boundary screen A20 are 
to the analysis screen A16. which can then exit back to the main screen A12. 

in this manner an advantageous screen architecture is formed which can be easily used and underwood 
by the operator. This screen structure facilitates the Interactive measurement of the nuclear DNA of «ie 
particular cell subpopulation under study. The instruction screens provide an interactive use of the digita^ 
imaging system which combines the power of the system software and hardware with the judgment and 
knowledge of the operator. The screen structure automates the assay task of nuclear DNA quantitation whi e 
still permitting the operator to selectively choose the input data and control the process to a considerable 

'^^^Each screen A12-A20 contains a menu of the functions permitted for use while that particular screen is 
being displayed on the instruction monitor 62. The function that the system is to currently execute in a 
■particular menu is chosen by the operator with a cursor movement method using the standard cursor 
control keys of keyboard 36. While a particular screen is being shown on the monitor, the cursor movement 
keys are operable to position the cursor next to a particular function listed on the menu of that screen. 
While the cursor highlights the function by its position, the operator may select the function for execution by 

pressing the enter key. , . 

■me main screen 12 displays the main menu A22 illustrated in Rg. 18. The mam menu A22 provides 
five chorees which include 1) a specimen function A24. 2) a label function A24. 3) a set light function A 30. 
4) a calibrate function A32. and 5) an exit function A28. 

The calibrate screen A14 displays the calibrate menu A34 illustrated in Fig. 19. The calibrate menu A34 
provides seven choices which include 1) a check light function A36. 2) a set XY function A3a. 3) a focus 
function A40. 4) a measure function A42, 5) an XY-1 function A44. 6) an analyze function A46. and 7) a 
main function A48. 
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The adjust blue boundary screen A18 displays the adjust blue boundary menu A50 illustrated in Fig. 20. 
The adjust blue boundary menu A50 provides five choices which include 1) a set step size-B function A52. 
2) a toggle-B function A54. 3) an increase-B function A56. 4) a decrease-B function ASS. and 5) an exit 

'""^The adjust red boundary screen A20 displays the adjust red boundary menu A62 illustrated FiQ- Jl- 
The adjust red boundary menu A62 provides five choices which include 1) a set step size-R function A64 
2) a toggle-R- function A68. 3) an increase-R function A70. 4) a decrease-R function A66. and 5) an exit 

^""''?he t^alysis screen A16 displays the analysis menu A74 illustrated in Rg. 22. The analysis menu A74 
provides sixteen choices which include 1) a del-type function A76. 2) a classify function A78. 3) a focus-2 
function ABO. 4) a CK-light function A82. 5) a select 2nd function A84. 6) an area 1-2 function A86 7) a 
display XY function ASS. 8) a clear function A90. 9) a XY-2 function A92. 10) a report function A94. 11) a 
scale function A96, 12) a boundary-B function A98. 13) a boundary-R function A100. 14) a mam function 
A1 02 1 5) a mask function A1 04. and 1 6) a disappear function A1 06. 

The label function allows a user to enter infomiation regarding patient identification, accession number 
and DNA conversion number. The DNA conversion number is the number that the first and second peak 
masses are divided by to get the first and second peak indexes. Initially, the number is set to a standard 
718 picograms/cell for normal human cells. However, the apparatus may be used to measure non-human 
cells and the index may be changed to that desired. The DNA index number must be greater than or equa 
to 1 0 and less than or equal to 99.99. If the conversion number is not within that range, the user is not 
allowed to select the analyze option in either the main or the calibration screens. 

The three lines of information entered during the label function will appear on every screen except the 
X Y field coordinate screen. The label operation is exited by pressing either the enter or escape key. 
p;essing the enter key will save any changes that were made to the three lines of information. Pressing me 
escape key will ignore any changes that were made to the three lines. The information stored dunng the 
label function will not be saved when the program Is exited. 

Selecting the calibrate function will cause a change of the display on instruction monitor 62 from the 
main screen to the calibration screen illustrated in FIG. 15. The calibration screen whose options are shown 
in FIG 19 are those necessary to perform calibration of the instrument for optical density and for staining 
factor on the control cells. A calibration of the apparatus 11 is to be performed every time a new slide is 
selected to normalize the light level and staining factor. , co ♦« 

Selecting the analyze function will cause a change of the display from the mam screen on monitor 62 to 
the analysis screen as illustrated in FIG. 16. The analysis screen contains the menu for the functions that 
are necessary to perform data acquisition and DNA measurements on the specimen cells. Ttiese funcftons 
are more fully set forth in FIG. 22. Three criteria must be met in order to select the analyze function. First 
the set light function in the calibration screen must have been successfully performed at least once. The set 
light function is successful when the current image is blank and the light level is between 129 and 131. 
Secondly, the calibration control cell count must be between 50 and 512. Finally, tiie DNA conversion 
number must be greater than or equal to 1 .0 and less than or equal to 99.99. 

The exit function allows the user to terminate the operation of the program from the main screen. 
Pressing the escape key is the same as selecting the exit function. When the exit operation is specified, 
either by selecting exit or pressing escape, the user will be asked to confimi his command to exit. To 
accept the confirmation, the user selects the yes key. To reject the confimiation. he selects the no key or 

presses the escape key. » v v f..„^ti«n a<»« 

The options of the calibration menu will now be more fully explained. The set X. Y of function A38 
provides the setting of the origin for the slide X. Y coordinate system. This function sets the current image 
or field location as the origin by zeroing a pair of location registers in the software. Generally, the 
microscope platform 51 is moved until a easily recognized landmark is visible, such as cross 53. This 
landmark is then used to rezero the coordinate system to provide a means of relocating Previously 
measured fields. The set X. Y function is used every time a new slide is selected. If the set X. Y function 
has not been executed, then tiie X. Y functions of tiie calibration and analysis screens and the f"ncUo"s in 
the X Y field coordinates screen will not work properly. The set X. Y function can only be used when tiie 
calibration control cell count is equal to zero. If ttie microscope platfonn 51 is being moved when the set X. 
Y operation is In execution, then Uie coordinate origin will be in error. The program provides a message on 
the screen to notify Wie operator when the set X. Y operation is successful. In response to the function not 
being successful, the operator merely reselects set X. Y from tiie menu and attempts the function again. 

The measure function A42 is used to perform tiie control cell or control object calibration for 
normalizing the staining factor. When tiie measure function is selected, the camera image acquisition will 
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stop and the cursor 170 on the calibration screen will move to the words "measure operations" in FIG. 15. 
When the cursor 170 is at this location, the user can specify measure operations by activating the numeric 
lock key. An identifier such as a magenta colored box will be placed around an identified ceil object. By 
using a number of key operations, the operator can perform an interactive selection and re|ection process 

5 which will be more fully explained hereinafter. 

During control ceil calibration, tiie operator moves the microscope stage by turning the conventional X 
and Y knobs 11 and 17 (FIG. 1) to shift tiie control ceil objects 40 into view on the image monitor 37. When 
an individual cell object 40 is within a box or identifier border 75, the operator presses a key on the 
keyboard 36 to enter measurement of tiie summed optical density for that control cell object. After a 

10 suitable number of control cell objects have been analyzed, tine operator will be provided witii a histogram 
such as shown in RG. 15 on tiie instruction monitor 62 which shows the operator the control cell object 
pioidy distribution as having a relative quantity of DNA. Internally within the system control 22. the summed 
relative optical density values actually measured for tiie control cell objects are compared to a predeter- 
mined standard or reference amount of DNA which tiie contirol cells are known to have. The actual summed 

75 optical density found by tiie operator is divided into the stored reference DNA value to provide a factor by 
which to adjust tiie extinction coefficient for deviations in the stain from a perfect staining. 

The XY-1 function A44 when selected displays on tiie calibration screen, the X, Y coordinates of the 
current image or field, on image monitor 37, The coordinates will be continuously displayed until tiie user 
presses a key (except CTRL, ALT. or SHFT), Thus, if tiie same origin for tiie slide 14 was set, the operator 

20 can. by positioning tiie platform 51 and watching tiie coordinates change, find the same image which was 
previously recorded. The set X. Y function A36 must have been successfully performed previously in order 
for the X, Y function to be selected. 

The FOCUS-1 function A40 provides color enhancement to tiie image so that the user can perform 
more precise focusing of the image. The system control 22 automatically provides different colors for 

25 gradations in grey level in the image. The operator tfien adjusts tiie focusing means of the microscope 15 
until the object being focused on. for example an edge of the border 54, shows a clear color demarkation. 
This is an indication that the two separate leveis or grey scale of the edge are in focus. This is much more 
difficult without color because the two grey levels may be close togetiier and undiscemible witiiout tiie color 
enhancement The set light function A30 must have been successfully performed at least once in order to 

30 select the focus function. To restore the image to its original color, the focus function is selected a second 
time. If tiie color enhanced image is present when tiie user selects tiie measure function, tiie image will 
automatically be returned to its original color. 

Selecting tiie analyze function will change tiie display from tiie calibration screen to tiie analysis screen. 
The analysis screen provides a menu of functions shown in FIG. 22 which are necessary to perform the 

35 DNA measurements on the cellular material. Three criteria must be met in order to select tiie analyzed 
function. Rrst. the set light function in the calibration screen must have been successfully performed at 
least once. Secondly, the calibration control cell count must be between 20 and 512. The analyze function 
in tiie calibration menu works the same way as the analyze function in tiie main menue. 
The analyze function options in tiie analysis menu are more fully shown in FIG, 22. 

40 The check light-2 function A82 calculates the light level of tiie current image. The light level value is 
displayed on the analysis screen by the words "light level" in FIG, 16. 

The select-2nd function A84 allows the user to select tiie second peak on the histogram displayed on 
the analysis screen. The mass. DNA index, and tiie area of tiie second peak are displayed on the screen 
under tiie words "second peak." The select-2nd function cannot be selected when tiie shown cell count is 

45 equal to zero. The shown cell count is displayed by the word "shown." After the select-2nd function has 
been selected, the cursor will move to a set of arrows and the current second peak location on the 
histogram will be highlighted in yellow. Initially the right most histogram data location is chosen as the 
second peak. Selecting the left arrow moves the second peak location to tiie left and the user selects the 
right arrow to move the second peak location to tiie right Every time an arrow is selected, the cun-ent peak 

50 data on the screen will be updated. 

Below the histograms horizontal axis, one of three symbols will appear undemeatti tiie second peak 
location, A "less than" symbol will appear if the second peak lies in area one. A "greater tiian" symbol will 
appear if the second peak lies in area two. An up arrow symbol will appear if tiie second peak ties in neitiier 
area one nor area two. The reason for the tiiree symbols is so tiiat the second peak location can be 

55 identified after tiie select-2nd operation is exited. The vertical yellow line disappears once the seiect-2nd 
function is exited. The users presses the ESC key to exit tiie select second operation. The second peak 
data will also be automatically cleared when one of tiie following analysis screen functions is selected: 
clear, report, scale, or main. 
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The classify function A7a allows the user to classify the cells or objects in the current image. After the 
classify function has been selected, the user will be asked to confirm the operation. To accept the 
confirmation, the user will select the yes key, and to reject the confirmation, the user will select the no key. 
or press the ESC key. If the classification function is confinmed, camera acquisition stosp and the cursor will 
move by the words "classify operation". When the cursor is at this location, the user can specify the 
classify operations by activating the numeric lock to enable these functions. As was the case in the 
measure function, a magenta colored box will be placed around a current cell and the operations allow the 
user to move this cell identifier through the image to identify and classify the cells therein. ^ ^ , . 

The display X Y function A88 will change the display from the analysis screen to the X, Y field 
coordinates screen. The X. Y field coordinate screen will display the X. Y coordinates of the first 512 
imaaes that have been classified and stored. Also, the screen contains the functions that allow the sorting of 
the image fields by coordinates. The set X. Y function in the calibration screen must have been successfully 
performed before the display X, Y function is selected. ^ v v 

The X Y field coordinate screen has several functions. One of the functions, "nearest sorts the X. Y 
coordinates according to the distance from the cun-ent X. Y field position. The X function will sort the X. Y 
coordinates according to the X coordinate value. If there is a tie. then the Y coordinate value will determine 
the sort order. Similarly the Y function will sort tiie X. Y coordinates according to the Y coordinate value. H 
there is a tie then X coordinate value will detemiine the sort order. The ''field#- function will sort the X. Y 
coordinates ^cording to the coordinates field number. The field number is tiie order in which the images 

were^da^rfied^ function allows the user to display ihe previous page of X. Y coordinates, if any. and the 
page down function allows the use to display the next page of X, Y coordinates, if any. The exit function 
changes the display from the X. Y field coordinate screen to the analysis screen. Pressing the escape key 
is the same as selecting ttie exit function. ^ ^. » -,, 

25 Selecting the X. Y function displays tine X. Y coordinates of the current field. The coordinates will be 
continuously displayed until the user presses a key (except CTRL. ALT. and shift). The set X. Y function in 
tiie calibration screen must have successfully been perfomied before the X. Y function is selected. The X. Y 
function in the X. Y field coordinate screen works the same way as tiie X. Y function in the calibration and 

30- The S?-?*function A90 will clear all analysis related areas of data. After the clear function has been 
selected, ttie user will be asked to confimi tiie clear operation. To accept tiie confimiation. the user selects 
ttie yes key or to reject the confirmation, tiie user will select ttie no key or press tiie ESC key. 

The focus-2 function A80 provides color enhancement to the image so ttiat tiie user can perform more 
precise focusing of the image. The focus-2 function in ttie analysis screen works ttie same way as the focus 
35 function in the calibration screen previously described. ^ . 

The area 1-2 function A86 allows tfie user to specify two areas in ttie histogram displayed m the 
analysis screen. The purpose of ttiis function is to identify tiie cell counts in certain areas in the histogram. 
The area 1-2 function cannot be selected when the shown cell count Is equal to zero. The cell counts are 
displayed at ttie lower right portion of tiie screen. After area 1-2 is selected, the cursor will move to a row of 
numbers ttiat Is below ttie histograms horizontal axis. The row of numbers allows the user to specify the 
locations of area 1 and area 2. The user types a "1" to specify that the current histogram position belongs 
to area 1 The user types a "2" to specify ttiat ttie position belongs to area 2. The user types a 0 to 
specify ttie current histogram position belongs to neittier area 1 or 2. The user is allowed to specify an area 
1 without an area 2. but cannot specify an area 2 without an area 1. When both areas are specified, area 1 
must be specified to ttie left of area 2. The area must be specified as continuous. To exit tiie area 1-2 
function, ttie user presses the enter or ESC keys. If the user presses the enter key. area 1 of the histogram 
will be highlighted in green and ttie area 2 will be highlighted in magenta. The area cell counts will also be 
displayed. Pressing tiie ESC key will cause ttie program to disregard any of the changes that were made. 
Area 1 and area 2 data will automatically be cleared when one of the following functions is selected: 

so classify, clear, reports, scale or main. •„ , x , 

The analysis function is more fully described witii respect to FIGS. 13 and 14. The operator will select a 
number of field locations 360. 361. and 362 in the slide specimen area 58 for analysis. The operator will 
adjust ttie X and Y knobs 11 and 17 for ttie microscope stage 51 to move these fields into view on ttie 
image monitor 37 a first field of specimen cell objects to be analyzed for DNA content as well as for cell 

55 morphology if desired (FIG. 13). The program will place a box. for example at 300. over a particular 
specimen cell object being displayed on the monitor 37 and then ttie operator will use a key to cause the 
scanning of ttie pixels (picture elements) of ttie specimen object to classify the cell in a manner similar to 
ttiat disclosed in U.S. Patent 4,453.266 to give summed optical density for ttie cell specimen object i.e.. a 
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Stained cell nucleus, as well as its area, its roundness, and other classification information. 

Also, the operator has on the keyboard 36 several cell classification keys to be manually operated and 
the operktor depresses one of the keys of a known category such as a type 0 normal cell; a type 1 cancer 
cell- a type 2 cancer cell: a type 3 cancer cell; and etc. On the monitoring screen 62 there will be an 
analysis histogram displaying the DNA content of the cells in the field. The operator selects a number of 
cells in each field or area and then moves the microscope stage to position a number of different fields of 
specimen colls into view and takes and analyses a number of these specimen cells until the operator feels 
he has enough cells for a representative sample. 

A histogram, will at this time be displayed on the instruction monitor screen 62 which shows the 
number of cells of a particular DNA content and shows the DNA content averages for each of the reference 
peaks, such as shown in FIG. 16. By depressing a print key. on the keyboard 36 the operator may print out 
the histogram shown in FIG. 16 on the printer 38. The data for the specimen cells is also stored internally 
within the system control 22 for later recall and comparison with data of any new specimen from the same 
patient for analysis relating to the progress or regression of a patient. 

The operation of the manual classification for the analysis function will be now more fully described with 
respect to FIG. 13 where there is shown a visual field which has been previously stored in the instrument. 
The field contains a number of cell objects which are to be classified and measured as to DNA content. 
When the program initially comes into this mode of operation, the first object in the field will be identified by 
scanning the pixels of the field In a raster like manner until a cell object is recognized. Once a cell object is 
recognized, an identification means such as box 300 is drawn around the object. This provides a visual 
identifier for the operator to determine which cell object is presently being measured. In addition to the 
measurement the operator is provided with a number of options from the analysis menu. The pnmary 
option that an operator has Is to classify a cun-ent object in block A78. He accomplishes this by pressing 
one of the numeric keys 0 through 5 which automatically puts the cell object of the identifying box 300 into 
the classification selected. If the object identified is- debris, not an abnormal cell, or not an identifiable cell 
object, the operator can reject the cun-ent object by selecting a 9 on the keyboard as indicated. 

After the classification or rejection of the object in box 300. the operator can move the identification box 
to the next unmeasured object. An operator accomplishes this by pressing the keys CTRLyF2 which causes 
the program to erase the box 300 and search for the next identifiable cell object. This cell object is found, 
and then another identifying box 302 is drawn around it to indicate to the operator the function has been 
accomplished. In this manner, the entire group of cell objects can be classified and measured or rejected 
by repeating this process. In this manner, the program steps through the analysis procedure from object 
300 to 302.304. 306. 308, 310, etc. ,^ ^ 

Further, if one of the cell objects to be classified does not look like the operator thinks it should and. it 
35 cannot be put in one of the previous classifications, or for some other reason the operator believes ha has 
classified a previous object by mistake, then by pressing CTR17F1, he can move the identifying box back to 
the previously measured object After identifying all cell objects in the particular field being displayed, the 
operator has the option of going to .another field by manipulating the X. Y positioning mechanism to provide 
more cells for the particular analysis. . . ^ u. »!»h«. 

When the operator has determined that enough cell objects had been analyzed, he may either 
temiinate the analysis function by pressing either the enter key or escape key. If he terminates the analysis 
function by pressing the enter key. then the data assembled from each of the measurements will be saved. 
However if the analysis function is terminated by pressing the ESC key. then the data will not be saved. 

The report function A94 allows the user to specify which cell classifications are to be included in the 
histogram shown on the screen of the instruction monitor 62. After the report function has been selected, 
tfie cursor can be moved to a option list which will allow the operator to specify the cell types. The following 
table specifies which key tiie operator presses in order to select a particular cell type. 
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normal 0 or n 
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lymphocyte 5 or L 
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Any combination of the types for the report data is allowed. The program will ignore any other 
characters than those listed in the table. The operator exits the report operation by pressing the enter or 
escape key If the operator presses the enter key. he will change the types of cells in the histogram to 
those which were specified. However, if the escape key is selected, the program will ignore any changes 
5 that were made and return normally. The function area 1-2 data and the second peak data will automatically 
be cleared when the report operation is performed. ' . ^ ^ ■.- » 

The scale function A96 allows the operator to change the scale of the horizontal axis of the histogram 
provided on the analysis screen. There are three scales to choose from. 0-16. 0-32. and 0-64. If the scale 
function is selected when the current scale is 0-16. then the new scale will be 0-32. If the scale function is 
10 selected when the current scale is 0-32. then the new scale will be 0-64. Ukewise. if the scale function is 
selected when the current scale is 0-64, then the new scale will be 0-16. In this function the area 1. area 2, 
and second peak data will automatically be cleared when the scale operation is performed. 

The boundary functions A98. A100 will change the display on instraction monitor 62 from the analysis 
screen to the respective adjust boundary screen. The adjust boundary screen contains functions that are 
IS necessary to change the cell boundary, i.e.. threshold. While addressing the boundary screen, camera 
image acquisition will be halted. 

The set step size function of Rgs. 20 and 21 allows the operator to change the amount by which the 
boundary will change when one of the arrow keys is selected. The value must be in the range of 0-128. 
After the step size is selected, the cursor will move to the location on the screen where the user can type in 
20 a new step size value. To exit the step size function, the enter or escape keys are used. Pressing the enter 
key will save the step size change where pressing the escape key will ignore any change that was made. 
Initially, the step size value is equal to one. . ^ «, 

The increase function A56. A70 will increase the cell boundary by the value of the step size and the 
decrease function A58. A66 will decrease the cell boundary by the value of the step size. The exit functions 
25 A60. A72 change the display from the adjust boundary screens back to the analysis screen. Pressing the 
escape key is the same as selecting the exit function. 

In general, an interactive data collection and analysis scheme Is used by tiie apparatus for the 
collection of specific parameters for both Uie calibration cell objects and the specimen cell objects. Each 
field which is selected is displayed on tine image /nonitor 37 and either the measure operation of the 
30 calibration screen or the classify operation of «ie analysis screen is chosen. 

A software flow chart of a subroutine providing ttie interactive operations for tiie calibrate key operations 
and the analysis key operations. FIGS. 15 and 16 and is illustrated in the referenced Bacus application. 
When the operator selects either tiie measure operations or the classify operations, this program is called to 
generate the selection process for botii tiie calibration cell objects and the specimen cell objects. The 
35 program begins by performing a raster scan of ttie stored image pixel by pixel until it finds a pixel greater 
than the Uireshold value. If no pixel is found which is greater tiian the tiireshold. a determination of whether 
the scan is complete is made, if not tiie scan is cominued until all pixels in tiie image field are tested. After 
all pixels have been tested, ttie scan parameters are reset and tiie cell object anray updated. 

At the time an image pixel is determined to be greater than the tiireshold. the program will label tiie 
40 object The operation of labelling will now be more particularly described. The individualized cell objects in 
the digitized image are located by a scene analysis technique in which tiie raster scan is made of the 
digitized image to locate any pixel above ttie critical threshoW. The technique then performs a four neighbor 
analysis of adjacent pixel elements and continues in a recursive manner locating "neighbors of the 
neighbors" which are above tfie tiireshold until the entire region of a cell object is defined. This technique is 
45 prefen-ed to other scene analysis techniques, such as local boundary found from a gradient image, because 
it is fool proof in distinguishing tiie true region of a cell, particularly ttiose cells having irregular or spiculed 

projections. . > i.. u 

The four pixels (top. bottom, right side, and left side) surrounding tiie initially located pixel which are 
contiguous ttierewith are examined sequentially to identify Uie next pixel with a optical density or gray level 

so value above tfie threshold. For instance, if the pixel located above the first pixel is not above tiie tiireshold. 
It is discarded from tiie labelling routine. The next pixel (right side) in a clockwise direction is then 
examined and may be above ttie tiireshold. If so. that pixel is then identified and stored in memory with the 
pixel as being a portion of ttie region of a cell. Next tiie address and density of the pixel found is stored in a 
pushdown list and the four neighboring pixels of tiiat pixel are examined in the same clockwise order. This 

55 continues in a recursive manner until no neighbors are found above a threshold for a particular pixel. At ttiis 
point the prior pixels on ttie pushdown list are reexamined to continue tiie neighbor search process until the 
entire nuclear of pixels defining a region, i.e.. the cell object has been identified. Thus, each of the pixels 
above tfie tiireshold of ttie region are identified and a complete enclosed region has been defined for a cell. 
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Once a cell object is labelled, a cell object table is set up for the object. The table lists the address of 
its entry point pixel, the number of pixels in the object the X, Y points for the minimum and maximum 
points of the object, a count of the pixels in the perimeter of the object the sum of the optical density of the 
object pixels, any classification provided for the object, and the X, Y coordinates of the field to which the 

5 object belongs. A plurality of the cell object tables comprise a temporary array, called a field anray, which is 
used to store the interactive data developed for the present field image under consideration. 
- Next, a box or identifying border is placed around the object using the X, Y limits. This mode identifies 
a particular object in the field for the operator. A key handler is entered to obtain a key press from the 
operator to determine which of the key functions of the classification function are to be accomplished. The 

70 key handler further determines which operation, either for calibration or analysis, is to be performed and 
only those keys which are associated with the present mode are enabled, all others are locked out Once a 
key has been obtained, the program will determine which function was selected and the progress of the 

routine. . 

Keys 0-5 as detected provide for the acceptance of a calibration object or the classiftcation ot a 

75 specimen object. If such key is detected, then the object is colored (red) to indicate to the operator that it 
has been accepted or classified. The operator classifies the cell objects into different categories based upon 
visual clues such as morphology and the optical markings. The cells for analysis can be classified into a 
normal class 0, or one of several abnormal classes 1-5. The data class of the object is stored to its place in 
the associated object data table. Calibration objects are classified as type 0 or normal. The program then 

20 returns to where the image scan registers are incremented to scan the field for the next object 

Alternatively, if the key press was a 9 as this means either a calibration cell object was rejected or a 
current specimen cell object was rejected. Thus, the rejected ceil object is colored in a different color 
(white) than an accepted or classified cell object, and the program returns to the scanning rouUne to find 
another object Coloring the cell object alerts the operator that the object has been analyzed in this field. 

25 coloring the object another color differentiates the object from an accepted or classified cell objects. 

If. however, the key press is a CTRLypI, then the operator desires to move the identifying box to the 
last previously measured object. The program will then intenrogate the field array to find the last object 
pointer. This pointer is used to create the box around the previous cell object before getting another key 
press. By using a series of CTRUF1 keys the operator may selectively move the identifying box from 

30 previously measured cell object to previously measured cell object in a reverse direction. If. after the box is 
placed around a particular cell object the operator desires to reclassify that cell object, he then has the 
option of classifying it with the keys 0-5 in block A326. 

The identifying box may be moved to the next unmeasured cell object by selecting the key CTRL/F2. 
The key. if found, immediately returns the program control to the image scan entry. The effect of this 

35 operation is to allow the operator to skip the present cell object and move the identifying box to the next 
cell object without either rejecting or accepting the present cell. A series of CTRL/F2 presses will move the 
box forward through the cells without measuring them. 

If all of the cell objects in a particular field appear normal as specimen cells, or as is generally the case 
with control cells they are acceptable, the operator may want to classify them all automatically. To 

40 accomplish this, an operator presses the key CTRL/F3. This key press is detected and transfers control to 
where the automatic mode flag is set. The program then returns to the entry of the image scan. However, 
instead of going through the normal sequence of placing a box around the next object and waiting for a key 
press, the program will loop to automatically classify the rest of the cells of a field. 

Another option that the operator can select is the cell cutting function which is entered by pressing the 

4S key CTRLyF4. This key is detected and transfers control to the cell cutting function operation. When the 
CTRL and F4 keys are pressed, the user enters the cell cutting mode. While in this mode, the user Is 
permitted to make cut lines inside the identifier box. The operator cannot make a cut line over a pixel that 
belongs to a measured or a rejected cell. A measured cell is a ceil that has been classified as type 0. 1, 2. 
3, 4, or 5. Numeric lock must be activated in order to perform a cell cutting operation. A cross hair is 

50 located where the cut is to take place. The following table lists the cell cutting operations that can be 
performed plus the key that must be pressed in order to select the desired operation. The function allows 
the splitting of overiapping ceils by artificially making a perimeter between two areas, a cut. Thus, the 
labelling routine will only label one area as a ceil object. 
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(KEY) (ACTION) 

0 Turn splitting on and off 

1 Go down and left one step 

2 Go down one step 

3 Go down and right one step 

4 Go left one step 

5 Go to the center of the box 

6 Go right one step 

7 Go up and left one step 

8 Go up one step 

9 Go up and right one step , 
EN?ER Be-dl last step (up to lOO pxxels) 

ESC Exit cell splitting mode 

A Step is three pixels. When beginning a new cut. the first pixel will not be cut. For operation 5. the 
cross hair will not move if the center pixel belongs to a measured or rejected cell. 

After the cell cutting is performed in, the scanner registers are set to the entry point of the particular 
object cut The program then returns to the scan entry. Because the cell object has the same entry point 
but a different perimeter, the labelling routine will label the cell object as now cut. 

Another option that the operator has is the ability to select any object within a field. The selection of this 
mode is accomplished by pressing the CTRUF5 key. ^ ■ 

\Amen the CTRL and F5 keys are pressed, the user enters the selection mode. Numeric lock must be 
activated in order to perfonn a selection operation. A cross hair will appear at the current selection point. 
The following table lists the selection operations that can be performed plus the key that must be pressed 
In order to select the desired operation. 

(KEY) (ACTION) 

0- Select cross hair movement step size 
[5 or 153 

1 Go down and left one step 

2 Go down one step 

3 Go down and right one step 

4 Go left one step 

5 Go to the center of the image 

6 GO right one step 

7 GO up and left one step 

8 Go up one step 

9 Go up and right one step 
ESC Exit selection mode 

When the selection mode is exited, the box will move to the first unmeasured cell after the selection 
point. If there are no cells after the cross hair, the box will go to the next unclassified cell. 

After the object is selected by the above described technique, the scanner registers are set to the entry 
point of that particular object in block A348 and the program returns to the scan entry in block A300. This 
creates the identifier box around the object using its X. Y limits and provides the operator with the option of 
then pressing another key and performing other measurements and classifications on that selected object. 

Another function is provided by key CTRiyFB. This feature provides an operator with the ability to move 
the identifier box forward by reading the next cell object pointed to and then drawing around the box the 
chosen object in block A313. The keys CTRLyPI. CTRLyF2 thereby allow an operator to quickly revise 
previous cell classification by stepping forward and backwards, respectively, through the pointers of the 
previously meaisured cells. , , 

When the enter key is sensed, the cell object an^ay is updated with the present field array to store all of 
the data collected for the particular objects in the field. Alternatively, the sensing of the escape key returns 
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the program immediateiy to the place in the software where it was called. 

it will be appreciated that the illustrated control 22 has been programmed to do the cell classification 
and optical density analysis. Such classification and analysis is similar to that outlined in U.S. patent 
4 453.266 for the classification or red blood cells and the present invention can be particularly useful in the 
analysis of red blood cells wherein the optical density of the hemoglobin content is measured rather than 
the DNA content as above described. As common in red blood cell analysis, the red blood cells need not 
be stained for image enhancement so that the staining calibration step may be eliminated for red blood 
cells when using the specific wave length of light specified in the aforementioned Bacus patents. 

A further use of the present invention is to provide a precise measurement of hemoglobin in actual 
picograms for calibrating other instruments such as a Coulter counter. In such a process, the control blood 
cells 40 will have a known predetermined hemoglobin value and the specimen blood cells 52 of unknown 
hemoglcoin value will be placed on the specimen area 58. Then the apparatus will be calibrated to show the 
histogram for ttie hemoglobin content of the specimen cells 52. 

n -ria aiso be appreciated that the various calibration steps may be eliminated or combined and done 
simutuntKj^siy rather than done in the order and in the sequence and in the manner described for the 
preft^ffbC emtoctment of the invention in making a DNA analysis. 
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Claims 



1. A ovjtnod of anetydng a population of cell objects for a given parameter, characterised by the steps 
of opticAity ©rvhoocing iho population of cell objects for said parameten optically marking selected cell 
objects fn Mud pcpuiatKDo for a particular feature; providing a magnified image of the cell objects in said 
popuiaiTon :o a ucor-cbscrver through digital image processing; and gating cell objects of the analyzed 
population nto ooo of several subpopulation classifications based -upon morphological criteria of the cell 
objects and sa»d optcai markings as viewed by the user-observer. 

2 A method as claimed in Claim 1. characterised in that the population analyzed is a subpopulation. 

3. A method as Oaim 1 or Claim 2. characterised in that said step of optically enhancing the population 
of cell obiocts lor said parameter comprises staining the DNA of the nucleus of each cell object. 

4. A method as claimed in any preceding claim, characterised in that said step of optically marking 
selected coll objects comprises staining said selected cell objects with an Immunohistochemical technique 
using a monoclonal antibody against a specific antigen. 

5. A method as claimed in Claim 4. characterised in that said step of staining said selected cell objects 
with an immunohistochemical technique comprises staining with an alkaline phosphatase technique. 

6 A method of marking selected cell objects in a population and for measuring the DNA mass of 
predetermined classes of cell objects in the population, characterised by the steps of first staining the cell 
objects in the population with a immunohistochemical technique including a monoclonal antibody specific to 
a protein in at least one of the cell objects thereby marking any cell objects including said protein as to 
type; and second, staining the DNA in all the ceil objects in the population with a Feulgen technique. 

7 An apparatus for the analysis of a plurality of cell objects on a support, which have been optically 
enhanced by the enchancement of the nuclear DNA of the cell objects by a Feulgen staining technique and 
the enchancement of the location and content of specific protein sites of the cell object by an im- 
munohistochemical staining technique, characterised by means for magnifying an image of the cell objects; 
means for filtering said magnified image at a band of wavelengths where said areas of DNA staining are 
relatively opaque when compared with said areas of immunohistochemical staining to provide a first filtered 
image; means for filtering said magnified image at a bank of wavelengths where said areas of im- 
munohistochemical staining are relatively opaque when compared to said areas of DNA staining to provide 
a second filtered image; means for digitizing and storing said first filtered image and said second filtered 
image- means for combining said first filtered image with said second filtered image such that cell objects 
having areas of immunohistochemical staining are marked; means for displaying said combined image to an 
operaton means for gating each of the cell objects into one of several classifications based on morphologi- 
cal criteria of the areas of DNA staining and marked areas of immunohistochemical staining; and means for 
measuring the DNA mass of each of said cell objects and classifications of ceil objects. 

8 A cell analysis method for determining the mass of certain areas of specimen cells selected from a 
cell subpopulation. characterised by the steps of providing a slide with a reference area and a specimen 
area; providing specimen cells with areas of unknown mass in said specimen area; staining said reference 
cells and said areas of said specimen cells with the same stain; staining selected cells of said specimen 
cells in different areas with another stain; measuring the optical density of the stained reference cells; 
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d^mining a staining factor from said measured optical density of said stained reference cells and said 
oredetermined mass of said reference cells: measuring the optical density of said areas of unknown mass 
for a class of said specimen cells based upon their morphological characteristics and the selected cells with 
different areas of stain; and determining the mass of said areas of said class of specimen cells from said 
measured opticai density and said staining factor. . - i 

9 A method as claimed in Claim 8, characterised in that said stain and said another stain vary m color, 
and in that said step of measuring includes identifying said different areas of said selected cells by 
selectively filtering an image of said cell population: and marking cells with different stained areas to 
become selected cells. 
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